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(54) Device for avoiding collisions 

(57) An interference avoiding device capable of de- 
termining occurrence of an interference in a robot (5) 
operation in advance and automaticalfy avoiding the in- 
terference, to be suitably applied to an automatic pick- 
ing-up operation of randomly stored workpieces (10). A 
position/orientation of a workpiece and a position/orien- 
tation of a tool for getting hold of the workpiece in a 
teaching operation, and shapes/dimensions of the tool 
and the storage box (4) are determined and stored in a 
storage device. A command position/orientation Ta of 
the tool for getting hold of an objective workpiece is de- 
termined based on a detected position/orientation Wa 
of the workpiece and it is determined whether or not an 



interference between the tool an the storage box will oc- 
cur based on the position/orientation Ta and the stored 
information. If it is determined that an interference will 
occur, a rotational phase or an inclination angle of the 
tool with respect to the workpiece is changed within an 
allowable range of the position/orientation of the tool 
with respect to the workpiece, to obtain a new position/ 
orientation of the tool. If it is determined that an interfer- 
ence will not occur under the new condition of the posi- 
tion/orientation of the tool, the new position/orientation 
is adopted. If an interference is still determined to occur, 
an alarm is issued and the operation of the robot is 
stopped. 



.FIG.1 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0001] The present invention relates to a technique of 
avoiding an interference in an operation to be performed 
by an industrial robot. 

2. Description of the Related Art 

[0002] In a picking operation of picking up a plurality 
of workpieces stored randomly in a storage box with a 
robot, it is necessary to control position/orientation of a 
robot and a tool, i.e. an end effector such as a robot 
hand, attached to a distal end of the robot so that the 
hand can hold one objective workpiece in the plurality 
of workpieces. Position/orientation of workpieces are 
scattered since these workpieces are stored randomly. 
Thus, the position/orientation of the tool and the robot 
arm has to be changed in accordance with position/ori- 
entation of the objective workpieces to be picked up, to 
cause an interference between the tool or the robot and 
a peripheral object such as the storage box storing the 
workpieces. 

[0003] In general, if an interference is found in the 
teaching operation, the interference can be avoided by 
modifying the position/orientation of the tool in the 
teaching operation. However, it is not assured that the 
interference is avoided in an actual operation in the 
above picking operation. Thus, it has been necessary 
to place an objective workpiece to have predetermined 
position/orientation in every picking operation or pre- 
pare an ambience around the workpieces which never 
cause an interference. 

[0004] Preparing a complete ambience around the 
randomly stored workpieces requires laborious work 
and a long time to be contrary to labor saving and auto- 
mated operation by a robot. 
[0005] If a workpiece is placed to have predetermined 
position/posture, it is possible for an operator to teach 
a robot so as not to cause an Interference through an 
off-line programming. However, a burden on the opera- 
tor increases as to how to avoid an interference by 
teaching the robot appropriate position/orientation of the 
tool. 

SUMMARY OF THE INVENTION 

[0006] The present invention provides an interference 
avoiding device capable of determining an interference 
In an robot operation In advance and avoiding the Inter- 
ference. With the interference avoiding device of the 
present invention, it is unnecessary to prepare a specific 
ambience around an object of operation of the robot 
even in a picking operation of randomly stored workpiec- 
es, to reduce a burden on an operator. 
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[0007] An interference avoiding device of the present 
invention comprises: storing means for storing informa- 
tion on shape/dimensions of a operational device at- 
tached to a robot, and shape/dimensions and position/ 

5 orientation of a peripheral object; interference determin- 
ing means for determining an interference between the 
operational device and the peripheral object based on 
the information stored in the storing means and a com- 
manded position/orientation of the operational device; 

io position/orientation setting means for setting a new po- 
sition/orientation of the operational device for avoiding 
the interference between the operational device and the 
peripheral object in place of the commanded position/ 
orientation of the tool, when it is determined that an in- 

15 terference will occur by the interference determining 
means. 

[0008] The position/orientation setting means may 
automatically determine the new position/orientation of 
the operational device for avoiding the interference. Al- 
so ternatively, the position/orientation setting means may 
select one of a plurality of predetermined positions/ori- 
entations. 

[0009] Alternatively, the position/orientation setting 
means may seta newly taught position/orientation of the 

25 operational device for avoiding the interference. 

[0010] The interference avoiding device may further 
comprise means for continuously operating the robot in 
accordance with the new position/orientation of the op- 
erational device. 

30 [0011] The position/orientation setting means may 
stop an operation of the robot when it is determined that 
an interference will occur by the interference determin- 
ing means. 

[0012] The interference avoiding device may further 

35 comprise determining means for determining an inter- 
ference between the operational device and the periph- 
eral object on condition of the new position/orientation 
of the operational device, and display means for display- 
ing a message when it is determined that an interference 

40 will occur by the determining means. 

[0013] The interference avoiding device may further 
comprise determining means for determining an inter- 
ference between the operational device and the periph- 
eral object on condition of the new position/orientation 

45 of the operational device, and control means for sus- 
pending an operation of the robot when it is determined 
that an interference will occur by the determining means 
and then resuming the operation of the robot. 
[0014] The position/orientation setting means may re- 

50 write an operation program of the robot by replacing the 
commanded position/orientation of the tool with the new 
position/orientation for avoiding the interference. 
[0015] The Interference determining means may de- 
termine an interference between the operational device 

ss and the peripheral object in operation of the robot. 
[0016] The interference avoiding device may be incor- 
porated into a robot controller or an information process- 
ing device connected to the robot. The information 
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processing device may include an operation simulation 
device of the robot. 

[001 7] The new position/orientation of the operational 
device may be used for obtaining information by means 
a sensor attached to the robot. 
[001 8] The commanded position/orientation of the op- 
erational device may be determined based on informa- 
tion obtained by a sensor attached to the robot. In this 
case, the storing means may store information on posi- 
tion/orientation of a workpiece in a teaching operation 
and position/orientation of a tool as the operational de- 
vice for grasping the workpiece in the teaching opera- 
tion, and the commanded position/orientation of the tool 
is determined based on the determined position/orien- 
tation of the workpiece and the stored information on the 
positions/orientations of the workpiece and the tool in 
the teaching operation. Alternatively, the storing means 
may store information on position/orientation of a tool 
as the operational device for holding a workpiece with 
respect to position/orientation of the workpiece in a 
teaching operation based on CAD information in an off- 
line teaching device, and the commanded position/ori- 
entation of the tool is determined based on the deter- 
mined position/orientation of the workpiece and the 
stored information on the position/orientation of the tool 
with respect to the position/orientation of the workpiece. 
[0019] The sensor may comprise a two-dimensional 
sensor or a three-dimensional sensor. 
[0020] The operation to be performed by the robot 
may be a picking operation of picking up a workpiece by 
the operational device, and the peripheral object is a 
storage box storing workpieces. Further, the operation 
to be performed by the robot may be one of spot welding, 
arc welding and sealing. 

[0021 ] The robot may be directly or indirectly fixed to 
a structure fixed on a floor, a wall or a ceiling, and may 
be arranged to be movable along one or two axes. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0022] 

FIG. 1 is schematic view showing a picking opera- 
tion of a robot controlled by a robot controller in 
which an interference avoiding device of the 
present invention is incorporated; 

FIG. 2 is a schematic view showing the operation 
of picking up an objective workpiece by a tool at- 
tached to the robot as shown in FIG. 1 ; 

FIG. 3 is a schematic plan view showing a relation- 
ship between an objective workpiece and the tool 
box; 

FIGS. 4a and 4b are schematic diagrams showing 
orientations of the tool in an interference and out of 
the interference by changing a rotational phase of 



the tool; 

FIG. 5 is a schematic side view showing orientation 
of the tool for avoiding an interference by changing 
s an inclination angle of the tool with respect to the 
objective workpiece; 

FIG. 6 is a flowchart of processing for avoiding in- 
terference according to a first embodiment of the 
10 present invention; 

FIG. 7 is a flowchart of processing for avoiding in- 
terference according to a second embodiment of 
the present invention; and 

15 

FIG. 8 a flowchart of processing for avoiding inter- 
ference according to a third embodiment of the 
present invention. 

20 DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0023] FIG. 1 shows an embodiment of the present 
invention in which an interference avoiding device is 
25 constituted by providing a robot controller for controlling 
an industrial robot with a software for avoiding an inter- 
ference. 

[0024] A tool 3 as an operational device for succes- 
sively picking up a plurality of workpieces 10, a camera 

30 2 as a two-dimensional visual sensor for capturing an 
image of workpieces 10 including an objective work- 
piece to be picked up, a laser beam projector 1 for pro- 
jecting a laser beam are attached to a wrist provided at 
a distal end of an arm of a robot 5. A three-dimensional 

35 visual sensor is comprised of the camera 2 and the laser 
beam projector 1. In this embodiment, the plurality of 
workpieces 10 are randomly stored in a storage box 4, 
each having a random position/orientation. 
[0025] The robot 5, the laser beam projector 1, the 

40 camera 2 and the tool 3 have conventional features and 
therefore detailed description thereof are omitted. The 
robot controller 6 has a conventional hardware architec- 
ture including a processor, a ROM, a RAM, a nonvolatile 
RAM, an data input device with a display, an input/output 

45 interface, a camera interface, servo controllers for con- 
trolling servomotors for respective joint axes of the robot 
5. The laser beam projector 1 and the tool 3 are con- 
nected to the input/output interface and the camera 2 is 
connected to the camera interface. 

50 [0026] For performing a picking-up operation of a 
workpiece 10, the robot 5 is operated to move the wrist 
to take a position/orientation at which the camera 2 on 
the wrist can capture an Image of the workpieces Includ- 
ing an objective workpiece as an object of the picking- 

55 up operation in the storage box 4 and then an image of 
the workpieces is captured by the camera 2 with projec- 
tion of the laser beam from the laser beam projector 1 
to detect position/orientation of the objective workpiece 
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upon receipt of commands from the robot controller 6. 
The position/orientation of the tool 3 is controlled in ac- 
cordance with the detected position/orientation of the 
objective workpiece and the workpiece is picked up by 
the tool 3 from the storage box 4. Details of the position/ 
orientation of the tool in the picking-up operation will be 
described. 

[0027] The position/orientation Ta of the tool 3 for get- 
ting hold of the objective workpiece 1 0 is determined ac- 
cording to the following equation (1), using a matrix Wn 
representing the position/orientation of the workpiece in 
a teaching operation, a matrix Tn representing the po- 
sition/orientation of the tool 3 for getti ng hold of the work- 
piece having the position/orientation Wn in the teaching 
operation, and a matrix Wa representing the position/ 
orientation of the objective workpiece detected by the 
three-dimensional sensor comprised of the camera 2 
and the laser beam projector 1 , 

Ta = Wa*lnv(Wn)*Tn (1) 

where Inv(Wn) represents an inverse matrix of Wn. 
[0028] The position/orientation Wn of the workpiece 
in the teaching operation, and the position/orientation 
Tn of the tool 3 for getting hold of the workpiece in the 
teaching operation, and further information on shapes 
and dimensions of the tool 3 and shapes and dimen- 
sions and positions/orientation of the storage box 4 are 
determined and stored in the memory of the robot con- 
troller 6 in advance, and it is determined whether or not 
the tool 3 will interfere with the storage box 4 based on 
the position/orientation Ta of the tool 3 determined ac- 
cording to the equation (1), the information on the 
shapes and dimensions of the tool 3, and the information 
on the shape and dimensions and the position/orienta- 
tion of the storage box 4. 

[0029] If it is determined that the tool 3 will Interfere 
with the storage box 4, a new position/orientation of the 
tool 3 for getting hold of the workpiece without interfering 
with the tool box 4 is obtained within an allowable range 
of the position/orientation of the tool 3 for getting hold 
of the workpiece. 

[0030] The allowable range of the position/orientation 
of the tool 3 is defined in dependence upon the shape 
and dimensions of the workpiece and a position or re- 
gion at which thetool 3 gets hold of the workpiece. FIGS. 
2-5 illustrate the allowable range of the position/orien- 
tation of the tool 3 in getting hold of the workpiece. In 
this embodiment, each workpiece 10 has a hole 10a at 
a center thereof, and the tool 3 is designed to get hold 
of the workpiece 10 by inserting claws 3a into the hole 
1 0a and spreading the claws in the hole 1 0a. Thus, the 
tool 3 can get hold of the workpiece 10 with arbitrary 
rotational phase in inserting the claws into the hole 1 0a 
of the workpiece 10, i.e., rotational position of the claws 
in the hole 10a to get hold of and pick up the workpiece 
10. This means that the tool 3 has a full angular allow- 
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able range with respect to rotation around a longitudinal 
axis of the claws 3a. On the other hand, an inserting 
angle at which the claw 3a of the tool 3 is inserted into 
the hole 10a to get hold of the workpiece 10 has a re- 
5 stricted allowable range. This allowable range of the in- 
serting angle is defined by an angle between an central 
axis of the hole 10a and the axis of insertion of the tool 
at which the tool 3 can hold the workpiece by spreading 
the claws 3a. 

10 [0031 ] In this example, the tool 3 has the full range of 
rotation around the central axis of the hole 1 0a and the 
restricted range of freedom with respect to the central 
axis of the hole 1 0a in the above case of the workpiece 
1 0 and the tool 3. The allowable range of position/orien- 
ts tation of the tool is changed in accordance with the 
shape and dimensions of the workpiece to be picked up 
and a manner of getting hold of the workpiece. Specifi- 
cally, in the case of a tool for get hold of a cylindrical 
workpiece by clamping the workpiece with a pair of 
20 claws on outer circumference of a cylindrical workpiece, 
the tool has an allowable range of translation in a direc- 
tion along a central axis of the cylindrical workpiece. In 
this case of the tool and the workpiece, the tool has a 
predetermined allowable range of the position/orienta- 
25 tion for getting hold of the workpiece in the direction of 
the central axis of the cylindrical workpiece which is de- 
termined based on dimensions of the workpiece and de- 
sign of the claws. 

[0032] Referring to FIGS. 2-5 again, FIG. 2 shows a 
30 state where the tool 3 does not interfere with the storage 
box 4. As shown in the plan view of FIG. 3, in the case 
where an objective workpiece is positioned near a cor- 
ner of the storage box 4, the tool 3 may interfere with 
the storage box 4 in getting hold of the workpiece by 
35 inserting the claws into the hole 10a, as shown in FIG. 
4a. If it is determined that an interference will possibly 
occur between the tool 3 and the storage box 4, it is 
assumed that the interference will occur between the 
tool 3 and a member such as a side wall of the storage 
40 box 4 which is closest to the objective workpiece. In this 
example, it is determined that a side wall 4a is a member 
of the storage box 4 closest to the objective workpiece 
10. 

[0033] The rotational phase of the tool 3 is changed 
45 by rotating the tool 3 around a center 3c of rotation of 
the tool 3, i.e. the central axis of the hole 1 0a so that a 
portion on an outer contour of the tool 3 which has the 
smallest radius from the center 3c of rotation is directed 
to the closest side wall 4a. With this rotation of the tool 
so 3, an interference between the tool 3 and the side wall 
4a in the state of FIG. 4a will not occur in the state as 
shown in FIG. 4b. 

[0034] In the case of occurrence of an Interference as 
shown in FIG. 5, this interference is not avoided by 
55 changing the rotational phase of the tool 3. In this case, 
the direction of insertion of the claws which is the other 
factor of the allowable range of the position/orientation 
of the tool is changed. A critical angle 8 at which the tool 
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3 is out of interference with the closest side wall 4a 
based on the position/orientation of the objective work- 
piece and the shape and dimensions of the storage box 
4. Then, it is determined whether or not the critical angle 
e is within the allowable range of inclination of the tool 
3 and the workpiece. If it is determined that the critical 
angle 6 is within the allowable range of inclination, the 
tool 3 is inclined by the critical angle 6 to avoid the in- 
terference. 

[0035] Described above is principle of an interference 
avoiding method in the first embodiment of the present 
invention. A concrete procedure for picking up workpiec- 
es stored randomly in a storage box will be described 
referring to a flowchart of FIG. 6. 
[0036] First, information on shape/dimensions of the 
tool 3 and shape/dimensions and position/orientation of 
the storage box 4, and the position/orientation Wn of the 
workpiece in the teaching operation, and the position/ 
orientation Tn of the tool 3 for getting hold of the work- 
piece having the position/orientation Wn are determined 
and stored in the storage device of the robot controller 
6. For example, the position/orientation Wn of the work- 
piece and the position/orientation Tn of the tool may be 
set based on CAD information in an off-line teaching de- 
vice. 

[0037] The robot is operated such that the camera 2 
can capture an image including an objective workpiece 
in the storage box 4 and a position/orientation of the ob- 
jective workpiece is detected based on the image cap- 
tured by the camera 2 with the laser beam projection 
from the laser beam projector 1 (Step S1 01). The posi- 
tion/orientation Ta of the tool 3 for getting hold of the 
objective workpiece is obtained according to the equa- 
tion (1) using the detected position/orientation Wa of the 
objective workpiece and the stored position/orientation 
Wn of the workpiece and the stored position/orientation 
Tn of the tool 3 in the teaching operation. A relative po- 
sition/orientation of the tool 3 withe respect to the stor- 
age box 4 is calculated based on the obtained position/ 
orientation Ta and the stored position/orientation of the 
storage box 4 (Step 102), and it is determined whether 
or not the tool 3 will interfere with the storage box 4 
based on the relative position/orientation of the tool and 
the stored information on the shape and dimensions of 
the tool 3 and the shape and dimensions of the storage 
box 4 (Step 103). 

[0038] If it is determined that an interference will not 
occur, the obtained position/orientation Ta of the tool 3 
is outputted (Step S112), to terminate the interference 
avoiding processing. If it is determined that an interfer- 
ence will occur, a side member of the storage box 4 clos- 
est to the objective workpiece is determined (Step 1 04). 
In the example shown In FIG. 3, the side wall 4a is de- 
termined as the side member closest to the objective 
workpiece 10. 

[0039] The rotational phase of the tool 3 is changed 
such that a portion having the shortest radius from a 
central axis of rotation of the tool 3, i.e. a longitudinal 
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insertion axis of the claws, is directed to the closest side 
wall 4a, and a position/orientation of the tool 3 with the 
changed rotational phase is calculated (Step 105). It is 
further determined whether or not an interference will 

s occur between the tool 3 having the calculated new po- 
sition/orientation and the storage box 4 (Steps 1 06 and 
1 07). If it is determined that any interference will not oc- 
cur in Step 1 07, the position/orientation of the tool 3 ob- 
tained in Step 105 is outputted (Step 112). 

10 [0040] If it is determined that an interference will occur 
in Step 107, a critical angle 9 of inclination of the tool 3 
at which the tool 3 does not interfere with the closest 
wall 4a of the storage box 4 is obtained (Step 1 08), and 
the information of the position/orientation of the tool 3 is 

15 changed such that orientation fulfills the condition of the 
critical angle e to change the inclination angle with re- 
spect to the objective workpiece (Step 108, 109). It is 
determined whether or not the inclination angle of the 
tool is within the allowable range of inclination with re- 

20 specttothe central axis 1 0a of the workpiece (Step 1 1 0). 
If it is determined that the inclination angle is within the 
allowable range, the position/orientation obtained at 
Step 109 is outputted. 

[0041] If it is determined that the inclination angle is 
25 not within the allowable range in Step 11 0, it is decided 
that the interference can not avoid in this operation and 
an alarm message is displayed on the display device of 
the robot controller 6 and also the operation of the robot 
5 is stopped (Step 111). 
30 [0042] Thus, when an alarm message is displayed on 
the display device and the operation of the robot is 
stopped, it means that the robot can not pick up an ob- 
jective workpiece without interference with the storage 
box 4. This may be caused for a reason that the objec- 

35 tive workpiece positions near a corner of the storage box 
4. In this case, an operator may move the objective 
workpiece manually in the storage box 4 and then op- 
erate a restart switch on the teaching operation panel 
so that the robot resumes the picking-up operation from 

40 the processing of Step 101. 

[0043] An interference between the tool 3 and the 
storage box 4 is determined and avoided in the above 
embodiment. Besides the storage box 4, if there Is any 
peripheral object which has possibility of causing an in- 

45 terference with the tool 3, shape/dimensions and posi- 
tion/orientation of such object are determined and 
stored in the storage device of the robot controller 6, and 
an interference of the tool 3 with the object can be de- 
tected and avoided in the manner same as the above- 

50 described interference avoiding processing. 

[0044] Further, in the case where there is a possibility 
of causing an interference between the robot itself, in- 
cluding a robot arm and a wrist, etc., and the storage 
box 4 or peripheral objects, such interference can be 

55 detected and avoided. In this case, shape/dimensions 
of the robot are additionally stored in the storage device 
of the robot controller 6 and an interference between the 
robot and the object is determined based on the posi- 
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tion/orientation of the robot in getting hold of an objec- 
tive workpiece by the tool 3 and the information on the 
shape/dimensions of the robot. 
[0045] In the above embodiment, the angular phase 
and/or the inclination angle of the tool are automatically 
changed when it is determined that an interference will 
occur. Alternatively, the position/orientation of the tool 
may be newiy taught to be changed when it is deter- 
mined that an interference will occur. Such processing 
for changing the position/orientation of the tool will be 
described referring to FIG. 7 as a second embodiment. 
[0046] First, an image of workpieces including an ob- 
jective workpiece is captured and position/orientation 
Wa of the objective workpiece is obtained (Step 201), 
the position/orientation Ta of the tool 3 is obtained based 
on the obtained position/orientation Wa of the work- 
piece, and a relative position/orientation of the tool with 
respect to the storage box is calculated (Step 202), and 
it is determined whether or not an interference will occur 
(Step 203) in the same manner as the processing from 
Step 101 to Step 103 in the first embodiment. If it is de- 
termined that an interference will not occur, the obtained 
position/orientation Ta of the tool is outputted (Step 207) 
in the same manner as the processing of Step 112 in 
the first embodiment. 

[0047] If it is determined that an interference will occur 
in Step 203, new position/orientation of the tool to be 
appropriate for avoiding the interference is taught by an 
operator by directly inputting information thereon or 
through a teaching operation by operating the robot with 
manual feed visually confirming the position/orientation 
of the tool with respect to the objective workpiece (Step 

204) , It is determined whether or not an interference will 
occur on the condition of the renewed position/orienta- 
tion of the tool, the information on the shape/dimensions 
of the tool, the information on the position/orientation 
and the shape/dimensions of the storage box (Step 

205) . If it is determined that an interference will not occur 
in Step 205, the renewed position/orientation of the tool 
is outputted (Step 207). If it is determined that an inter- 
ference will occur on the renewed condition, an alarm is 
issued and the operation of the robot is stopped (Step 

206) . 

[0048] If it is determined in Step 205 that the interfer- 
ence is avoided by the newly taught position/orientation 
of the tool at Step 204, the newly taught position/orien- 
tation of the tool may be stored in the memory for auto- 
matically applying the stored position/orientation when 
the same interference is prospected. Further, in this sec- 
ond embodiment also, an interference of the tool with 
peripheral objects other than the storage box can be de- 
tected and avoided, and an interference of the robot it- 
self with the storage box and the peripheral objects can 
be detected and avoided in the same manner as de- 
scribed on the first embodiment. 
[0049] FIG. 8 shows a flowchart of processing for de- 
termination and avoiding an interference according to a 
third embodiment. 
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[0050] In this third embodiment, when it is determined 
that an interference will occur, the orientation of the tool 
is changed to any of a predetermined plurality of orien- 
tations and it is determined whether or not the an inter- 
5 ference will occur with the changed position/orientation 
of the tool. The plurality of predetermined orientations 
of the tool may include orientations with which operating 
portions, such as fingers and claws, of the tool are di- 
rected vertically downward, inclined at a predetermined 
io angle, i.e., 20 degree with respect to the vertical line to- 
ward a center of the tool box, etc. 
[0051] First, an image of an objective workpiece is 
captured by the camera and position/orientation Wa of 
the workpiece is obtained (Step 301), the position/ori- 
is entation Ta of the tool 3 for getting hold of the detected 
objective workpiece is obtained, a relative position/ori- 
entation of the tool 3 with respect to the storage box 4 
is obtained (Step 302), and it is determined whether or 
not an interference will occur (Step 303), in the same 
20 manner as the processing from Step 1 01 to Step 1 03 in 
the first embodiment. If it is determined that an interfer- 
ence will not occur in Step 303, the obtained position/ 
orientation Ta of the tool is outputted (Step 308) in the 
same manner as the processing of Step 112 in the first 
25 embodiment. 

[0052] If it is determined that an interference will occur 
in Step 303, one of the predetermined orientations of 
the tool stored in the storage device is selected (Step 
304) and it is determined whether an interference will 
30 occur or not on the new condition of the position/orien- 
tation of the tool with the selected orientation (Step 305). 
If it is determined that an interference will not occur in 
Step 305, the new position/orientation of the tool with 
the selected orientation is outputted (Step 308). If it is 
35 determined that an interference will occur on the new 
condition, next one of the predetermined orientations is 
selected (Step 304) and it is determined whether or not 
an interference will occur on the new condition of the 
position/orientation of the tool with the newly selected 
40 orientation (Step 305). If it is determined that an inter- 
ference will not occur in Step 305, the new position/ori- 
entation of the tool is outputted (Step 308). If it is deter- 
mined that an interference will occur on every condition 
of the position/orientation of the tool with every prede- 
45 termined orientation, an alarm is issued and the opera- 
tion of the robot is stopped (Step 307). 
[0053] Further, in this third embodiment also, an inter- 
ference of the tool with peripheral objects other than the 
storage box can be detected and avoided, and an inter- 
50 ference of the robot itself with the storage box and the 
peripheral objects can be detected and avoided in the 
same manner as described on the first embodiment. 
[0054] In the foregoing embodiments, the Interfer- 
ence avoiding device is incorporated into the robot con- 
55 troller. The interference avoiding device may be com- 
prised of an information processing device such as a 
personal computer connected to the robot or incorpo- 
rated into the robot controller. Particularly, it is preferable 
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to incorporate the interference avoiding device into a 
simulation device for simulating an operation of a robot 
for use in off-line teaching of an operation of the robot. 
In these cases, it is necessary to set and store informa- 
tion on shape/dimensions of a robot, a tool, a storage 
box, peripheral objects; position/orientation of a work- 
piece and the tool in get hold of a workpiece in teaching 
operation; and programs for carrying out the above-de- 
scribed interference avoiding processing in the informa- 
tion processing device. The information processing de- 
vice such as the simulation device executes the forego- 
ing processing of determining and avoiding an interfer- 
ence as shown in FIGS. 6, 7 and 8, and if it is determined 
that an interference will not occur, the information 
processing device may rewrite an operation program of 
the robot to store the position/orientation of the tool for 
picking up the objective workpiece, instead of outputting 
the position/orientation of the tool to the robot in Steps 
112, 207 and 308. 

[0055] In the foregoing embodiments, the description 
is made on an operation of a robot for picking up a work- 
piece by getting hold of the workpiece by a tool. The 
interference avoiding device of the present invention 
man be applied to robot operations such as arc welding, 
spot welding, sealing, etc. to be carried out by a tool 
attached to the robot, so that an interference between 
the tool or the robot itself and peripheral objects is pros- 
pected and avoided. 

[0056] The robot may be arranged at arbitrary position 
to be directly or indirectly fixed on a structure fixed on a 
floor, a wall, a ceiling, etc. Further, the robot may be ar- 
ranged movable along one or two axes. For example, 
the robot may be moved on rails extending along an X- 
axis and a Y-axis perpendicular to each other. In this 
case, the robot controller may control the robot, regard- 
ing the X-axis and the Y-axis on which the robot is 
moved as additional axis of the robot. Alternatively, a 
controller other than the robot controller may control mo- 
tions of the robot on these axes. With these arrange- 
ments capable of moving the robot itself, the robot can 
take an appropriate position/orientation which does not 
cause an interference. 

[0057] Further, the present Invention can be applied 
to an operation of a robot for detecting position/orienta- 
tion of an objective workpiece twice or more by the visual 
sensor. In this case, a visual field of the visual sensor is 
regarded as an allowable range of the position/orienta- 
tion. For example, for determining the position/orienta- 
tion of a camera of the visual sensor in a second detec- 
tion based on a result of a first detection, the position/ 
orientation of the camera in the second detection is de- 
termined such that an optical axis of the camera in the 
second detection coincides with a line of sight on an ob- 
jective workpiece in the first detection, to securely detect 
the position/orientation of the objective workpiece in a 
field of vision of the visual sensor, even if the objective 
workpiece is at arbitrary position in the field of vision in 
the first detection. The allowable range of the position/ 



orientation of the camera is the field of vision in the first 
detection. 

[0058] Further, in the foregoing embodiments, a 
three-dimensional visual sensor for detecting three-di- 

s mensional position/orientation including a distance be- 
tween the camera and the objective workpiece by the 
combination of the camera and the laser beam projector. 
In the case where an objective workpiece is placed at a 
predetermined position and the distance between the 

10 camera and the objective workpiece is already known, 
a two-dimensional visual sensor without projection of 
the laser beam can be adopted. 
[0059] According to the present invention, an interfer- 
ence between a device such as a tool attached to a distal 

15 end of a robot or the robot itself and a peripheral object 
around an objective of operation such as a storage box 
is automatically determined, and if it is determined that 
an interference will occur, the interference is securely 
avoided. 

20 

Claims 

1 . An interference avoiding device for avoiding an in- 
25 terference between an operational device attached 

to a robot and a peripheral object, comprising: 

storing means for storing information on shape/ 
dimensions of the operational device, and 
30 shape/dimensions and position/orientation of 

the peripheral object; 

interference determining means for determin- 
ing an interference between the operational de- 
35 vice and the peripheral object based on the in- 

formation stored in said storing means and a 
commanded position/orientation of the opera- 
tional device; 

40 position/orientation setting means for setting a 

new position/orientation of the operational de- 
vice for avoiding the interference between the 
operational device and the peripheral object in 
place of the commanded position/orientation of 

45 the tool, when it is determined that an interfer- 

ence will occu r by said i nterf erence determi n ing 
means. 

2. An interference avoiding device according to claim 
so 1 , wherein said position/orientation setting means 

automatically determines the new position/orienta- 
tion of the operational device for avoiding the inter- 
ference. 

55 3. An interference avoiding device according to claim 
1 , wherein said position/orientation setting means 
determines the new position/orientation of the op- 
erational device by selecting one of a plurality of 
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predetermined positions/orientations. 

4. An interference avoiding device according to claim 
1 , wherein said position/orientation setting means 
sets position/orientation of the operational device 
for avoiding the interference as a new taught posi- 
tion/orientation. 

5. An interference avoiding device according to claim 
1 , further comprising means for continuously oper- 
ating the robot in accordance with the new position/ 
orientation of the operational device. 

6. An interference avoiding device according to claim 
1 , wherein said position/orientation setting means 
stops an operation of the robot when it is deter- 
mined that an interference will occur by said inter- 
ference determining means. 

7. An interference avoiding device according to claim 
1 , further comprising determining means for deter- 
mining an interference between the operational de- 
vice and the peripheral object on condition of the 
new position/orientation of the operational device, 
and display means for displaying a message when 
it is determined that an interference will occur by 
said determining means. 

8. An interference avoiding device according to claim 
1 , further comprising determining means for deter- 
mining an interference between the operational de- 
vice and the peripheral object on condition of the 
new position/orientation of the operational device, 
and control means for suspending an operation of 
the robot when it is determined that an interference 
will occur by said determining means and then re- 
suming the operation of the robot. 

9. An interference avoiding device according to claim 
1 , wherein said position/orientation setting means 
rewrites an operation program of the robot by re- 
placing the commanded position/orientation of the 
tool with the new position/orientation for avoiding 
the interference. 

10. An interference avoiding device according to claim 
1 , wherein said interference determining means de- 
termines an interference between the operational 
device and the peripheral object in operation of the 
robot. 

11 . An interference avoiding device according to claim 

I , wherein said interference avoiding device is In- 
corporated into a robot controller or an information 
processing device connected to the robot. 

12. An interference avoiding device according to claim 

II, wherein said information processing device in- 



cludes an operation simulation device of the robot. 

13. An interference avoiding device according to claim 
1 , wherein the new position/orientation of the oper- 

5 ational device is used for obtaining information by 
means a sensor attached to the robot. 

14. An interference avoiding device according to claim 
1 , wherein the commanded position/orientation of 

10 the operational device is determined based on in- 
formation obtained by a sensor attached to the ro- 
bot. 

15. An interference avoiding device according to claim 
15 14, wherein said storing means stores information 

on position/orientation of a workpiece in a teaching 
operation and position/orientation of a tool as the 
operational device for holding the workpiece in the 
teaching operation, and the commanded position/ 
20 orientation of the tool is determined based on the 
determined position/orientation of the workpiece 
and the stored information on the positions/orienta- 
tions of the workpiece and the tool in the teaching 
operation. 

25 

16. An interference avoiding device according to claim 
14, wherein said storing means stores information 
on position/orientation of a tool as the operational 
device for holding a workpiece with respect to posi- 

30 tion/orientation of the workpiece in a teaching oper- 
ation based on CAD information in an off-line teach- 
ing device, and the commanded position/orienta- 
tion of the tool is determined based on the deter- 
mined position/orientation of the workpiece and the 

35 stored information on the position/orientation of the 
tool with respect to the position/orientation of the 
workpiece. 

17. An interference avoiding device according to claim 
40 14, wherein said sensor comprises a two-dimen- 
sional sensor or a three-dimensional sensor. 

18. An interference avoiding device according to claim 
14, wherein the operation to be performed by the 

45 robot is a picking operation of picking up a work- 
piece by the operational device, and the peripheral 
object is a storage box storing workpieces. 

19. An interference avoiding device according to claim 
so 14, wherein the operation to be performed by the 

robot is one of spot welding, arc welding and seal- 
ing. 

20. An interference avoiding device according to claim 
55 14, wherein the robot is directly or indirectly fixed to 

a structure fixed on a floor, a wall or a ceiling. 

21. An interference avoiding device according to claim 
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14, wherein the robot is arranged to be movable 
along one or two axes. 

22. An interference avoiding device for avoiding an in- 
terference between a robot and a peripheral object, 
comprising: 

storing means for storing information on shape/ 
dimensions of the robot, and shape/dimensions 
and position/orientation of the peripheral ob- 
ject; 

interference determining means for determin- 
ing an interference between the robot and the 
peripheral object based on the information 
stored in said storing means and a commanded 
position/orientation of the robot; 

position/orientation setting means for setting a 
new position/orientation of the robot for avoid- 
ing the interference between the robot and the 
peripheral object in place of the commanded 
position/orientation of the robot, when it is de- 
termined that an interference will occur by said 
interference determining means. 

23. An interference avoiding device according to claim 

22, wherein said position/orientation setting means 
automatically determines the new position/orienta- 
tion of the robot for avoiding the interference. 

24. An interference avoiding device according to claim 

23, wherein said position/orientation setting means 
determines the new position/orientation of the robot 
by selecting one of a plurality of predetermined po- 
sitions/orientation of the robot. 

25. An interference avoiding device according to claim 
22, wherein said position/orientation setting means 
sets position/orientation of the robot for avoiding the 
interference as a new taught position/orientation. 

26. An interference avoiding device according to claim 
22, further comprising means for continuously op- 
erating the robot in accordance with the new posi- 
tion/orientation of the robot. 

27. An interference avoiding device according to claim 
22, wherein said position/orientation setting means 
stops an operation of the robot when it is deter- 
mined that an interference will occur by said inter- 
ference determining means. 

28. An interference avoiding device according to claim 
22, further comprising determining means for deter- 
mining an interference between the robot and the 
peripheral object on condition of the new position/ 
orientation of the robot, and display means for dis- 



playing a message when it is determined that an 
interference will occur by said determining means. 

29. An interference avoiding device according to claim 
s 22, further comprising determining means for deter- 
mining an interference between the operational de- 
vice and the peripheral object on condition of the 
new position/orientation of the operational device, 
and control means for suspending an operation of 

io the robot when it is determined that an interference 
will occur by said determining means and resuming 
the operation of the robot. 

30. An interference avoiding device according to claim 
is 22, wherein said controller rewrites an operation 

program of the robot by replacing the commanded 
position/orientation of the robot with the new posi- 
tion/orientation for avoiding the interference. 

20 31 . An interference avoiding device according to claim 
22, wherein said interference determining means 
determines an interference between the robot and 
the peripheral object in operation of the robot. 

25 32. An interference avoiding device according to claim 
22, wherein said interference avoiding device is in- 
corporated into a robot controller or an information 
processing device connected to the robot. 

30 33. An interference avoiding device according to claim 
32, wherein said information processing device in- 
cludes an operation simulation device of the robot. 

34. An interference avoiding device according to claim 
35 22, wherein the new position/orientation of the robot 

is used for obtaining information by means a sensor 
attached to the robot. 

35. An interference avoiding device according to claim 
40 22, wherein the commanded position/orientation of 

the robot is determined based on information ob- 
tained by a sensor attached to the robot. 

36. An interference avoiding device according to claim 
45 35, wherein said storing means stores information 

on position/orientation of a workpiece in a teaching 
operation and position/orientation of the robot for 
performing an operation on the workpiece in the 
teaching operation, and the commanded position/ 
so orientation of the robot is determined based on the 
position/orientation of the workpiece obtained by 
said sensor, and the stored information on the po- 
sitions/orientations of the workpiece and the robot 
in the teaching operation. 

55 

37. An interference avoiding device according to claim 
35, wherein said storing means stores information 
on position/orientation of the robot with respect to 



9 



17 



EP 1 256 860 A2 



position/orientation of the workpiece in a teaching 
operation based on CAD information in an off-line 
teaching device, and the commanded position/ori- 
entation of the robot is determined based on the po- 
sition/orientation of the workpiece obtained by said s 
sensor and the stored information on the position/ 
orientation of the robot with respect to the position/ 
orientation of the workpiece. 

38. An interference avoiding device according to claim " 
35, wherein said sensor comprises a two-dimen- 
sional sensor or a three-dimensional sensor. 

39. An interference avoiding device according to claim 
35, wherein the operation to be performed by the 
robot is a picking-up operation of picking up a work- 
piece, and the peripheral object is a storage box 
storing workpieces. 

40. An interference avoiding device according to claim * 
35, wherein the operation to be performed by the 
robot is spot welding, arc welding or sealing. 

41. An interference avoiding device according to claim 
35, wherein the robot is directly or indirectly fixed to * 
a structure fixed on a floor, a wall or a ceiling. 

42. An interference avoiding device according to claim 
35, wherein the robot is arranged to be movable 
along one or two axes. 
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